Anomalous relaxation and self-organization in non-equilibrium processes 

Ibrahim FatkuUin ^, Konstantin Kladko ^, Igor Mitkov and A.R. Bishop 
^Department of Mathematical Sciences, Rensselaer Polytechnic Institute, Troy, NY 12180 
^Department of Physics, Stanford University, Stanford, CA 94305 
'^Department of Physics and CIRCS, Northeastern University, Boston, MA 02115 
* Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Los Alamos, NM 87545 

(February 1, 2008) 

We study thermal relaxation in ordered arrays of coupled nonlinear elements with external driving. 
We find, that our model exhibits dynamic self-organization manifested in a universal stretched- 
exponential form of relaxation. We identify two types of self-organization, cooperative and anti- 
cooperative, which lead to fast and slow relaxation, respectively. We give a qualitative explanation 
for the behavior of the stretched exponent in different parameter ranges. We emphasize that this is 
a system exhibiting stretched-exponential relaxation without explicit disorder or frustration. 



The world around us is full of non-equilibrium and 
non-stationary processes, many of which are robust and 
easy to measure. However, there is no a priori reason 
to believe, that these non-equilibrium processes should 
fulfill universal laws, in a way equilibrium systems ful- 
fill laws of thermodynamics and statistical mechanics. It 
is, therefore, important to recognize examples of com- 
plex non-equilibrium processes organizing themselves in 
a simple and universal way, a phenomenon termed "self- 
organization" or "emergent behavior" Kolmogorov 
turbulence |3| is an example of such non-equilibrium pro- 
cess: Liquid, forced at macroscopic length scales, pro- 
duces a flow of energy from large to small length scales, 
and this flow organizes itself into a stationary univer- 
sal distribution. Turbulence is a steady, though non- 
equilibrium, process; the flow of energy is constant and 
the resulting self-organized probability distribution does 
not change in time. It is important to establish, whether 
boundaries of self-organization can be expanded to in- 
clude non-equilibrium and non-stationary processes. In 
this paper we show that dynamic self-organization can 
indeed be found in relaxational dynamics of extended 
systems and is manifested in stretched-exponential de- 
pendence on time of physical quantities. 

Stretched-exponential (oc exp [— (t/tre/)"]) relaxation 
laws have been observed in a large variety of physical and 
biological processes, such as recombination of carriers in 
semiconductors and polymers |^,^ , protein relaxation 
and folding 0,^, ligand binding to myog lobin Ijiol, re- 
laxation in magnetic clusters 1 1 1 1 , superconducting vor- 
tices |p!2t and charge density waves |13 1^, dynamics of 
alloys [p^ and glasses In the case of glasses, the 

stretching exponent a defines a glass transition temper- 
ature, Tg, i.e. a = 1 for T > Tg, and a < 1 for T < Tg. 
The non-exponential dynamics of glasses has long been 
related to the high degree of disorder, which leads to the 
existence of a large number of metastable states . 

Observations of non-exponential behavior in simpler 
systems, such as magnetic clusters and proteins 
suggests that a high degree of disorder is not a neces- 
sary requirement for a system to display anomalous relax- 



ation. Especially notable are recent observations of fold- 
ing dynamics in proteins, yeast phosphoglycerate kinase 
(PGK) and ubiquitin mutant 0. These proteins fold ac- 
cording to a "downhill folding" scenario meaning 
that the folding path between the unfolded and folded 
states is free of deep metastable minima, so the process 
of folding is "downhill" relaxation along this path. Nev- 
ertheless, the number of folded proteins, as a function 
of time, displays stretched-exponential behavior over a 
large time interval . 

In this Letter we present a simple minimal model which 
is translationally invariant and without disorder or ex- 
plicit frustration [|l9|, which displays perfect stretched- 
exponential relaxation over wide time intervals. The 
stretched exponent a changes continuously from slow re- 
laxation a < 1 to fast relaxation 1 < a < 2, as param- 
eters of the system vary. We identify dynamic self- 
organization as the origin of the stretched-exponential 
relaxation, and show, that slow and fast relaxation are 
caused by anti- cooperative and cooperative behavior, re- 
spectively. We provide a theoretical explanation of the 
discrete and continuous limiting cases. We also present 
a qualitative theory, which accounts for behavior of the 
stretched exponent in the intermediate range of parame- 
ters. 

Real life systems [4-9] are much more complex than 
our simple model. However, we conjecture that at least 
one underlying reason for stretched-exponential relax- 
ation is universal. Namely, self-organization^ with fast 
and slow relaxation corresponding to cooperative and 
anti-cooperative behavior. We suggest that proteins be- 
long to the anti-cooperative universality class. Our ar- 
gument is, that initially the protein is loose and deforms 
easily. When folding into a particular local pattern oc- 
curs, this part becomes stiff, making folding of neigh- 
boring parts more difficult, and therefore behaving in an 
anti-cooperative way. Similar anti-cooperative behavior 
occurs in our model system for negative values of the 
coupling, as we discuss below. 

Let us now specify the model. We consider a chain of 
nonlinear bistable elements. Each element is described 



1 



by the order parameter m„. The local energy E{u) has 
two minima, one of which is a metastable state (local 
minimum of energy) , the other one is the absolutely sta- 
ble state (absolute minimum of energy). We assume 
overdamped dynamics of u„ at the presence of delta- 
correlated thermal noise. Equations of motion of the 
system are: 



dt 



(1) 



Here (3 represents linear coupling of neighboring sites, 
F{u) = —dE/du = —u{u — uq){u — 1) is a forcing 
term, corresponding to the bistable polynomial poten- 
tial E{u) = (l/4)u4 _ (l/3)(wo -1- l)u^ + (l/2)wow^ The 
potential has two minima, u = and u — 1, separated 
by a barrier, u = uq. At uq = 1/2 the minima have 
equal energy. For uq < 1/2 the minimum u = 1 becomes 
absolutely stable and u = metastable, with energy dif- 
ference given by AE — 1/12 — l/6iio- The stochastic 
term / ^^"^ is given by a delta-correlated Langevin force 



(2) 



where T defines the temperature in our system pO[ . 
Eq. (^ can be viewed as discrete one-dimensional 
Ginzburg-Landau equation with noise. 




FIG. 1. Plot of a typical function n{t). Solid line rep- 
resents the result of numerical simulations. Dashed line 
is a stretched-exponential fit. Parameters are T — 0.01, 
uo = 0.35, (3 = 0.04. 

Let us first review equilibrium properties of our system. 
At T = the system is in the absolutely stable phase. 
When temperature is introduced, some (small) number 
of particles overcome the barrier because of equilibrium 
thermal fluctuations. The relative number of particles in 
the metastable phase is determined by Boltzmann statis- 
tics, and is exponentially small for temperatures much 
less than the energy difference between potential wells. 



Our goal is to study non-equilibrium and non- 
stationary process of relaxation from the metastable 
phase to the absolutely stable phase. We assumes that 
all sites are initially in the metastable phase, and then in- 
troduces the thermal noise. Due to fluctuations, particles 
start to overcome the barrier, and the number of particles 
in the absolutely stable phase increases. We monitor re- 
laxation by introducing the function n{t) = N{t)/No{T), 
which describes the ratio between the concentration of 
particles in the absolutely stable phase at time t and 
their equilibrium number No(T). In the thermodynamic 
limit of infinite chain length, n(t) is a well defined smooth 
function, which satisfies the conditions n{0) — and 
n(oo) = 1. 

We study relaxation numerically by integrating the 
Langevin equations (|^) defined on long chain segments 
{N — 200), and averaging the resulting functions n{t) 
over many noise realizations. To improve numerical con- 
vergence, we use an implicit integration scheme. Details 
of the numerical method will be reported elsewhere pil . 
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FIG. 2. Stretched exponent a as a function of inter-site 
coupling (3, for uq and T the same as in Fig. |l| Propagation 
failure bifurcation and one-site nucleus bifurcation are marked 
as /3c and /3i, respectively. 

A typical function n{t) is given in Fig. |^. Important 
global features of the relaxation, valid in all ranges of 
parameters, are: 

i) After a short transient time to (Fig. |l|), the sys- 
tem self-organizes and n{t) starts to obey the stretched- 
exponential form n{t) = 1 — exp[— (t/t^ei)"]- Note, that 
there are only two parameters in our fit, which are the 
stretched exponent a and the relaxation time trd- The 
precision of the stretched-exponential fit is extremely 
high, and is about 0.1% for t > to; 

ii) The stretched exponent a changes continuously, as 
temperature T and coupling /3 vary, see (Figs. |2| and |^). 
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The observed relaxation is fast (a > 1) for positive val- 
ues of P and slow (a < 1) for negative values of (3. As 
temperature T is increased, the stretched exponent a ap- 
proaches the Arrhenius law (a = 1), corresponding to the 
intrinsic frustration being overcome thermally; 

iii) The stretched exponent a approaches the value a = 
2 in the continuous limit of large (3, representing a binary 
relaxation channel. 

The dependence of a on /3 is given in Fig. |^. At zero 
/3 the system represents a set of uncoupled nonlinear 
sites. Each site is described by a one-dimensional Fokker- 
Planck equation. In this case relaxation is known to be 
described by an exponential (Arrhenius) law, with de- 
cay time determined by the lowest excited state of the 
Fokker-Planck operator ||2^. Therefore, for /3 = one 
has a = 1. 



becomes continuous and is described by the continuous 
Ginzburg-Landau equation. 
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FIG. 3. Stretched exponent a as a function of temper- 
ature T, for three different values of /3, above, below, and 
at the propagation failure bifurcation point. Parameters are 
uo — 0.35, 13 = 0.03; 0.043; 0.06. Other parameters are the 
same as in Fig. Q 

Let us now explain, why introducing positive/negative 
f3 corresponds to cooperative/anti-cooperative behavior, 
respectively. If (3 is positive, one may think of the inter- 
site coupling f3 as an elastic chain connecting neighboring 
sites n and n -\- 1. If a particle overcomes the barrier, it 
attracts its neighbors and makes it, therefore, easier for 
them to jump over the barrier. Contrary to this, negative 
coupling corresponds to a repulsive force, which makes 
relaxation of nearest neighbors more difhcult. (Indeed in 
the limit of large negative /3, our model produces a strong 
staggered dimerization of the lattice). We conclude from 
Fig. H that the cooperative behavior leads to fast relax- 
ation, a > 1, and anti-cooperative behavior leads to slow 
relaxation, a < 1. 

We will now discuss the behavior of the stretched ex- 
ponent a at large positive (3. In this limit the system 



du 
'dt 



^f3-^+F{u) + fix,ty 



(3) 



In the absence of thermal noise, topological excitations of 
this equation are fronts (kinks), which separate the abso- 
lutely stable and metastable phases. Due to the energy 
difference between the phases, the fronts propagate at fi- 
nite velocity u, increasing the size of the absolutely stable 
phase. When temperature is introduced, local fluctua- 
tions of the order parameter give birth to kink-antikink 
pairs (Fig. |^). These pairs counter-propagate, replacing 
the metastable phase by the absolutely stable one. Let 
us now estimate the probability for the order parameter 
m(0, t) at a; = to stay in the metastable phase after time 
t. This probability is approximately equal to the prob- 
ability P(t, Z), that no kink-antikink pair will be created 
by fluctuations during time t at a distance / ^ vt from 
the origin. If such a pair is created, then the newly-born 
kink has enough time to reach x = 0, before the time 
interval t elapses, and annihilate the metastable phase; 
see Fig. |[ Since fluctuations are local, one can estimate 
P{l,t) as exp[— where is a constant. Therefore, 
the probability to stay in the metastable phase after time 
t is approximately exp[— wi^/yy]. Since the number of par- 
ticles in the metastable phase after time t is proportional 
to this probability, we conclude that in the continuous 
limit the stretched exponent a = 2. Our numerical data 
(see Fig. ||) are in a good agreement with this prediction. 
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FIG. 4. New phase nucleation through birth and propa- 
gation of kink-antikink pairs (schematic). 

The fact, that the stretched exponent a = 2 in the con- 
tinuous case, is striking and has important consequences. 
Namely, space discreteness is necessary to observe con- 
tinuous dependence of a on parameters. We can rephrase 
this statement as follows. It is known, that critical prop- 
erties of equilibrium systems are described by continuous 
models, and these models can be organized into univer- 
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sality classes, such that each universahty class has a set 
of universal critical exponents We conjecture, 

that effective models for non-equilibrium, non-stationary 
self-organization, in particular relaxation, must include 
discreteness, in order to incorporate the continuous de- 
pendence of stretched exponents on parameters. 

Let us now consider the nontrivial dependence of the 
stretched exponent a on the coupling f3 and temperature 
T, for the intermediate values of /3, given in Figs. |2| and ^ 
(a more detailed discussion of these effects will be given 
in 1^). In the absence of noise, the topological excita- 
tions of system (| l|) undergo a sequence of bifurcations, as 
described in [^2| , ^5|j2q| . The most important of these bi- 
furcations is the propagation failure bifurcation, at which 
fronts cease to propagate, being pinned by the lattice. 
We denote the corresponding value of the coupling (3 as 
/3c. An analytical expression for /3c was derived by us 
in 1^ . The second important bifurcation point is /3i . At 
this point, a one-site nucleus of the globally stable phase, 
representing a bound state of a kink and antikink pair, 
becomes unstable, and "bursts" into counter-propagating 
kink and antikink. In p5[ | we have shown, that there ex- 
ists an infinite number of bifurcation points /3„, such that 
/3c < ■■■ < /3n < /3n-i... < /3i, corresponding to the in- 
stabilities of a one-site, two-site, three-site, etc. nuclei. 
In Fig H we see the corresponding change of shape in the 
coupling-dependence of the stretched exponent a, in the 
interval (3^ < P < Pi ■ Accordingly, Fig. || demonstrates 
a transition in the temperature-dependence of a, with /3 
crossing Pc- We conclude from Figs. ^ and ^, that this 
region of bifurcations is manifested as a characteristic 
feature of the non-equilibrium relaxation of the system. 

In conclusion, we have introduced a model of dy- 
namic self-organization, and conjectured that it should 
be applicable to stretched-exponential relaxation in many 
biological and physical systems. We studied proper- 
ties of self-organization in a simple model, and showed 
that fast /slow relaxation is related to cooperative/ anti- 
cooperative behavior. We showed, that neither explicit 
disorder nor frustration are necessary requirements for 
anomalous relaxation laws. In view of this, an exper- 
imental evidence of anomalous relaxation in a physical 
system should not be considered as automatic proof of 
disorder or frustration in the system. Appropriate non- 
linearity (arising, for example, from coupled degrees-of- 
freedom with feedback) can alone produce both the ingre- 
dients of local structures (" intrinsic disorder" ) and com- 
petition (of length-scales), leading to a distribution of 
metastable states and anomalous dynamics JT9| . The de- 
tailed analytical description of dynamic self-organization 
is a promising direction for future study. This will include 
extensions to higher dimensions as well as specific physi- 
cal models. We also note, that stretched exponents were 
also observed in equilibrium correlation functions p7[ , 
and it is important to understand, whether they can be 
related to their non-equilibrium counterparts. 
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